Papers with morphological and syntactic tasks
On the Language Neutrality of Pre-trained Multilingual Representations (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Existing studies have focused on cross-linguality of contextual embeddings . however, they are only moderately language-neutral by default . |
| Approach: | They propose to use unsupervised centering and fitting an explicit projection on parallel data to achieve stronger language neutrality. |
| Outcome: | The proposed model outperforms existing models on XNLI and NER tasks. |
Exploring Large Language Models for Classical Philology (2023.acl-long)
Copied to clipboard
| Challenge: | Recent advances in NLP have led to the creation of powerful language models for many languages including Ancient Greek and Latin. |
| Approach: | They propose to use encoder-only and encoder decoder architectures to create four models for Ancient Greek that vary along two dimensions for tasks of interest for Classical languages. |
| Outcome: | The proposed models improve on existing models of Ancient Greek and Latin and provide a large pre-training corpus for Ancient Greek to support the creation of a larger, comparable model zoo for Classical Philology. |